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Abstract As in the (/c, /)-RSK (Robinson-Schensted-Knuth) of [1], other super- 
RSK algorithms can be apphed to sequences of variables from the set 
{ti, tfc, Ml, ui}, where ti < ■ ■ ■ < t^, and ui < ■ ■ ■ < ui. While the (/c, Z)-RSK 
of [1] is the case where ti < Uj for all i and j, these other super-RSK's correspond 
to all the C^^^) shuffles of the t's and u's satisfying the above restrictions that 
ti < ■ ■ ■ < tk and ui < ■ ■ ■ < ui. We show that the shape of the tableaux produced 
by any such super-RSK is independent of the particular shuffle of the i's and u's. 

1 Introduction 

We follow the tableaux-terminology of [7]. The classical Frobenius-Schur-Weyl 
theory shows how the SSYT (Semi-Standard- Young- Tableaux) determine the rep- 
resentations of GL{m, C) (or gl{rn, C)). Here GL{m, C) {gl{m, C)) is the General 
Linear Lie group (algebra). Also, SYT (Standard- Young- Tableaux) play an im- 
portant role here. The notion of {k,l) SSYT is introduced in [1], where similar 
relationships between such tableaux and the representations of pl{k, I) are shown. 
Here pl{k,l) is the General Linear Lie super-algebra. 

The {k,l) SSYT are defined, via a (/c,Z)-RSK algorithm, as follows [1]. Fix 
integers /c, Z > 0, /c + Z > 0, and k + I symbols ti, ...,tk,ui, ...,ui such that ti < 
... < tk < ui < ... < ui. Let 



ak,i{n) = \( ) Vi e {ti, ...,tk,ui, ...ui}\. 



To map ak,i{n) to pairs of tableaux {P,Q), apply to each v G ak,i(n) the (/c,/)- 
RSK, in which the usual RSK insertion algorithm [7] is applied to the t^'s, and the 
conjugate correspondence (see [1]) is applied to the w-,'s; see the examples below. 
By the definitions of [1], the insertion tableau, P = P{y), mapped from v G ak,i{n), 
is (/c, /) semistandard; that is, it satisfies the following three properties: 

(a) The "t part" (i.e., the cells fflled with t^'s) is a tableau. 

(b) The tiS are nondecreasing in rows, strictly increasing in columns. 

(c) The Wj's are nondecreasing in columns, strictly increasing in rows. 

As in the usual correspondence, the recording tableau, Q = Q{v), indicates the 
order in which the new cells were added to P. Clearly, Q is SYT having the same 
shape as that of P. 
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A total order of {ti, ...,tk,ui, ...,ui} which is compatible with ti < ■■■ < tk 
and ui <■•■< ui, is called a shuffle (of ti,...,tk and ui,...,ui). For example, 
ti < ui < U2 < t2 is such a shuffle, compatible with ti < t2 and ui < U2- 
Clearly, there are C^^^) such shuffles; of these, Berele and Regev chose to work 
with ti < ■ ■ ■ < tk < ui < ■ ■ ■ < ui^ which we call the {k, I) shuffle (see [1, 2.4]). 
The shuffle ti < ui < t2 < U2 < ■ ■ ■ < t^ < u^, with its corresponding SSYT, 
appears in section 4 of [3] . 

Let / = I{k, I) denote the set of all such C^^') shuffles. Given A e I, there is a 
corresponding ^-RSK insertion algorithm; if v e ak,i{n), then v—^{P, Q) by that 

algorithm. P = Pa = P{v,A) is the insertion tableau, and Q = Qa = Q{v-,A) 
is the recording tableau. Here P is an ^d-SSYT; that is, it satisfies the following 
three properties. 

(a) P is weakly A-increasing in both rows and columns. 

(b) The tiS are strictly increasing in columns. 

(c) The ttj's are strictly increasing in rows. 

Example. Let k = l = 2, A, Bel = 1(2, 2), where 

A : ti < t2 < ui < U2 and B : ui < U2 < ti < t2. 



Let 



1 4 

U2,ti,t2,Ui 



Then 



U2 




tl 


U2 




tl 


t2 


U2 



tl 


t2 


U2 


Ui 





= Pa, 



while 



U2 




U2 


tl 




U2 


tl 


t2 



Ui 


U2 


t2 


tl 





Pb 



Thus V — ^{Pa,Q) and v — )-(Pb, Q), where 

A. B 



Q 



1 


2 


3 


4 





and Pa and Pb are as above. 
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Definition. Denote by sh(f, A) = sh(PA) the shape of the insertion tableau 
P{v,A) = Pa of V e ak,i{n) under the ^-RSK. 

Given a shuffle ^ e / and the pair (P, Q), where P is ^-SSYT, Q is SYT, and 
sh{P) = sh{Q), the A insertion algorithm can obviously be reversed. By standard 
arguments (see for example [7, chap. 7]) this yields 

Theorem 1. Let A & I be a shuffle. Then the A-RSK insertion algorithm 
v—^{Pa,Qa) is a bijection between ak,i{n) and 

{{Pa,Qa) I Pa isA-SSYT, Qa tsSYT, sHPa) = sh{QA)}. 

Remark. Denote such a tableau P = (Pij) and denote <a by <. Clearly, if 
Pi J = tr then Pi,j-i < Pi J < Pi,j+i and Pi-ij <Pi,j<Pij+i. Similarly, 
if Pi^j = Ur then Pij-i < Pij < Pij+i and Pi-ij < Pi,j < Pij+i- 

Denote by sh{v, A) the shape of tableaiix P{v, A) and Q{v, A). This brings us 
to our main result. 

Theorem 2. Let v e ak,i{n), A,BeI, v—^{Pa,Qa) and v^^{Pb,Qb)- Then 
sh(PA) = sh(PB). Consequently, Qa = Qb- 

In other words, the shape of the tableau obtained through any of the {k, l)- 
shuffle-RSK algorithms, is independent of the particular shuffle of the t's and it's. 

Definition. Let A & I and A h n, i.e. a partition of n. Let Q'a(A) denote the set 
of the ^-SSYT of shape A: 

cj^(A) = {T I T is A-SSYT, sh(T) = A}. 

Recall the definition of type{T) from [7, page 309]. 
Theorem 2 implies 

Theorem 3 [6]. Let A, B E I, A h n. Then there exists a bijection (p : Q'a(A) — >■ 
S_b(A) such that for all T e Sa(A), type{T) — type{(p{T)). (In fact, there exist 
(at least) d\ such canonical bisections, where d\ is the number of SYT's of shape 
X.) 

Theorem 3 appears in [6], where it is proven by a different method. Our proof 
of the theorem is as follows. 

Proof of Theorem 3. Is based on the following diagram: 



/ A-RSK 



{Pa,Q) 



V e ak,i{n), V 



{Pb,Q) 



Thus choose a SYT Q of shape A. Given P = Pa e ^a(A), get 

{Pa,Q) > V — — {Pb,Q) . 

inverse B-RbK 

A-RSK 



This defines the bijection ip = ip^ : (^{Pa) = Pb- Clearly, type(PA) = type(PB) 
and by Theorem 2, sh(PA) = sh(PB). ■ 



Recall from [2] the notation w{T) for the weight of a tableau T. For example, 



let 



T = 



tl 


tl 


U2 


Us 




t3 






Ui 


U3 






Ui 









then w{T) = x\x2Xsyly2yl- Also recall the "hook" (or the "super") Schur function 
HSx{x-y) = HSx{xi,...,Xk;yi,...,yi) [1],[2]. 
When A is the shuffle Aq : ti < ■ ■ ■ < tk < ui < ■ ■ ■ < ui, HSx{x; y) is given by 
HSx{xi,...,Xk;yi,...,yi) ^ w{T) 

[1, Thm. 6.10]. See also [4], [5] and [6]. 
It clearly follows from Theorem 3 that 
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Corollary 4. For any A e I, 

HSx{xi,...,Xk:,yi,...,yi) = ^ w{T) . 

Tg9a(A) 



Given a shuffle A G /, tfie A-RSK is based on A, on tfie regular RSK for the 
tj's and the conjugate-regular RSK for the u/s. 

In addition to the regular RSK, there is also the dual RSK [7, page 331]. Given 
the shuffle A e I, this leads to four possible ^-insertion algorithms: either the reg- 
ular or the dual for the tj's, and cither the conjugate regular or the conjugate dual 
for the Wj-'s. In fact, the previous A-RSK is: (t-regular, M-conjugate-regular) , which 
we denote as the (regular, regular)-74-RSK. Similarly, (t-regular, w-dual-conjugate) 
is the (regular, dual)-A-RSK. Similarly for the algorithms (dual, regular) -A- RSK 
and (dual, dual)-^-RSK. Each of these three new insertion algorithms exhibits a 
similar shape invariance under all shuffles A e I. 

Theorem 5. 

(a) Let V e ak,i{n), and A, B & I such that 

in. Qa). V - — , ' (Pb, Qb)- 



(regular , regular ) -A-RSK (regular , regular ) -B-RSK 

Then sh(P^) = sh(P^). Consequently, Q\ = Q%. 
(b) Let V e ak,i{n), and A, B & I such that 

in, Qa), V - — , , > (p^, Qh). 



(regular, dual)-A-RSK (regular, dual)-B- RSK 

Then sh(P^) = sh(P^). Consequently, Q\ = Q*^. 
(c) Let V e ak,i{n), and A, B ^ I such that 



V ^ > iPX,Q*A), V ^ . iPB,Q%)- 

(dual,regular)-A-RSK (dual,regular)-B-RSK 

Then sh(P^) = sh(P^). Consequently, Q\ — Q*^. 
(d) Let V e ak,i{n), and A, B & I such that 

in, Q*a), V I iPB, Qb)- 



(dual,dual)-A-RSK (dual,dual)-B-RSK 



Then sh(P^) = sh(P^). Consequently, Q\ = Q*^. 
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Clearly, Theorem 5(a) is Theorem 2 above. The proof of Theorem 2 is given in 
the next section, which is the main body of this paper. First we describe the A- 
RSK algorithm in details. The main step in the proof of Theorem 2 is Lemma 2.15. 
It shows that a transposition of the variables in the shuffle (i.e a single change in 
the order of some ti and uj), does not alter the shape of the resulting tableaiix. In 
section 3 we prove the remaining parts (b), (c), and (d) of Theorem 5, essentially 
by deducing them from Theorem 2. 

2 Invariance of Shape 

As in the {k, Z)-RSK, the ^-RSK insertion algorithm involves applying the usual 
RSK correspondence to the t^'s, and the conjugate correspondence to the uj^s. This 
is illustrated in the following example. 

Definition 2.1. For i,j e Z+, let c{i,j) denote the cell in row i and column j of 
a given tableau. 

Example 2.2. Under the shuffle A = ti < ui < t2 < U2 < ts, perform the 
insertion 



Ui 


t2 


t2 


Ui 













tl. 



(a) tl < ui => tl occupies c(l, 1). Now, a Ui is always bumped to the next 
column, hence ui is bumped to column 2. 

(b) ui < t2 =^ ui occupies c(l, 2). Now, a ti is always bumped to the next 
row, hence t2 is bumped to row 2. 

(c) -ui < t2 < U2 =^ t2 occupies c(2, 2), bumping U2 to column 3. 

(d) U2 > t2 =^ «2 settles in c(2, 3). 





tl 


t2 


t2 




tl 


Ui 


t2 


(a) 


Ui 


U2 




, (b) 


Ui 


U2 














t3 








tl 


t2 


t2 




tl 


Ui 


t2 


(c) 


Ui 


t2 




, (d) 


Ui 


t2 


U2 




h 








t3 





The proof of Theorem 2 will follow from the following analysis of the ^-RSK 
algorithm. 
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Lemma 2.3. Letp be an A-SSYT, v E {ti, tk, ui, ui}. The insertion P <— v 
is made of a sequence of several steps. In an intermediate m-th such a step, we 
have an A-SSYT P together with an element Pij that was bumped from c{i,j) by 

Pij, Pij^Pij, and we need to do the following insertion: 

(a) If Pi,j = tr, insert it into the i + 1-th row of P. 

(b) If Pij = Us, insert it into the j + 1-th column of P. 

We show that in both cases, the result would be an A-SSYT P* , and - except for 
the last step - together with a new element Pej' (bumped from c{i' ), which is 
to be inserted into P* . Moreover, 

(1) J/P,,, = tr then c{i'J') = c{i + 1,/) and f < j. 

(2) If Pi,j = Us then c{i',j') = c{i',j + 1) and i' < i. 
then 

Proof. Note that (2) is obtained from (1) by conjugation, hence it suffices to just 
prove (1). 

Proof of (1): Denote the i-th. row of P by 

cti aj-iPijaj+i ag, 

so aj = Pij and by assumption, Pij = tr- Thus 



ai 

P = bi 

Cl 



and Pij = tr is inserted into the i + 1-th row bi bf. 

Let bj'-i < Pij < bij>, so in P*, the i + 1-th row is 

h bj>_iPijbj>+i bf. 

Since Pij bumped Pij, we have Pij < Pij. Since Oj — Pij — tr, hence Pij < bj. 
Together with bj'-i < Pij < bj', this imphes that j' < j, hence 



ai 

P* = bi 

Cl 



aj-iPi,jO,j+i 



Ch 



bj'-iPijbj'+i hjbj+i bf 

Cj'-iCj'Cj' + i <^jCj + l Ch 
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By the induction assumption on P, we only need to verify that the part 

ay 
P 

of the j'-th. column is ^-semistandard, i.e.: since Pij —t^, we need to show that 
o-j' < Pi,j < Cj'. This follows from aj' < Pij < Pij = tr < hji < Cji. ■ 

Definition 2.4. Two shuffles A,B & I are adjacent if there exist ti and Uj such 
that 

1) ti < Uj in A. 

2) Uj < ti in B. 

3) All other pairs have the same order relations in A and in B. 

In that case, call A and B (ti, Uj)- adjacent. Thus A and B differ by the transpo- 
sition (ti, Uj). 

Remark 2.5. Trivially, for any A,B e / there exist Aq, Ai,...,An e / such that 
Aq = A, An — B, and A^ is adjacent to A^+i, < r < n — 1. Thus to prove 
Theorem 1, it sufflces to show that for all v G ak^i{n) and for every pair (^A,B) 
of adjacent shuffles, sh(f , A) = sh{v, B). Therefore for the rest of this section, let 
A, B & I he (tj, ttj)-adjacent, with ti <^ Uj and Uj <^ ti. 

Lemma 2.6. Let A E I, w E ak,i(n), and for some x e {ti, ...,tk,ui, ...,ui}, let 
w' be the sequence obtained by omitting from w all elements A-greater than x. Let 
Pa and P'^^ be the insertion tableaux: obtained from w and w' respectively under 
shuffle A. Then is a subtableau of Pa- 

Proof. Let w > Pa] P ■ 0, Pi, P2, Pn = Pa, and similarly let w' > P^; 

A-RSK A-RSK 

P':0,Pi,P^,...,P:n-Pk (m=K|). 

Assume P/ is a subtableau of Pj^, and insert (a corresponding) y in w. 

If X <^ y, y is not in w' so P/ is not affected. Also, inserting y into Pj^, y 
does not affect the subtableau P/ C Pj., since y bumps only elements that are 
A-greater than itself. 

A similar argument applies when y < x: now y is also in w' , and is inserted into 
P/ and into Pj.. Clearly, in Pj. it is also inserted into the subtableau P/ C P^., 
and the proof follows. ■ 
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Corollary 2.7. Let A, B e I be [ti^Uj) -adjacent, v G ak,i{n), v^^{Pa,Qa) and 
V — ^{Pbj Qb)- Then the elements that are both A-less and B-less than ti and Uj 

B 

form identical subtableaux in Pa and Pb- 

Proof. Denote by v' the sequence obtained by omitting from v all elements (^- 
and B-) greater than or equal to ti and Uj. By (tj, ttj)-adjacency, the largest 
element smaller than ti and Uj, in both A and S, is the same element x. Moreover, 
v' is obtained by omitting from v all elements which are {A- or B-) greater than 
X. Let P'j^ and P'^ denote the insertion tableaux of v' under shuffles A and B 
respectively. Then by Lemma 2.6, and P'^ are subtableaux of Pa and Pb 
respectively. But the elements that are A- or 5-less than ti and Uj are ordered 
identically in A and B, so P^ = P^. ■ 

Notation. As above, let A,B G I he two shuffles that are (t^, tij)-adjacent: 
ti < Uj in A and Uj < ti in B. Let v G ak,i{n), and denote v — ^{Pa,Qa) 

and V — >{Pb, Qb)- 

B 

Notation. Given the tableau Pa (and similarly for Pb), let regions f, 2 and 3 
denote, respectively, the regions occupied (f) by elements less than ti and Uj, (2) 
by ti and Uj, and (3) by elements greater than ti and Uj. 

Example 2.8. Let v = uitst2U2t2Uiti, and let 

A = tl < Ul < t2 < U2 < ts 
B = tl < Ul < U2 < t2 < t^. 

Then A and B are (tj, i(-,)-adjacent, with ti = t2 and Uj = U2, and 





tl 


Ul 


t2 




tl 


Ul 


U2 


Pa = 


Ul 


t2 


U2 


Pb = 


Ul 


t2 


t2 




ts 








ts 





In both tableaux, region 1 contains the elements ti and ui, region 2 contains t2 
and U2, and region 3 contains ^3. Note that in this example, regions f and 3 are 
the same in Pa as in Pb, and region 2 is identically shaped in Pa and Pb- We 
shall show that this is always true. ■ 

By Lemma 2.6, both region f , as well as the union of regions 1 and 2, form sub- 
tableaux in P. It is easy to check that region 2 does not contain the configuration 



a 


b 


c 


d 
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If it does, assume d = ti. Then b = uj, so uj < ti, and a ^ ti,Uj. Similarly if 
d = Uj. It follows that region 2 forms part of the rim of the subtableaux which is 
the union of regions 1 and 2. 

Remark 2.9. Note that (part of) region 2 in Pa (i.e. ti < uj) always looks like 



Uj 



Uj 



Uj 



Namely: Except possibly for the rightmost element, all other elements in a row 
are tj's. Similarly, except for possibly the top element, all other elements in a 



column are Uj^s. 



Similarly, in Pb (i.e. Uj < U), part of region 2 looks like 



Ujti 



Uj 



Denote v = vi ■ ■ - Vn- The tableau Pa is created by applying the ^-RSK inser- 
tion algorithm to each of vi, ...,Vn successively. For each Vm, let lm{A) denote the 
length of the insertion path [7, page 317] of Vm under shuffle A - that is, the num- 
ber of insertion steps that occur when Vm is inserted while forming Pa- The total 
number of insertion steps involved in the formation of Pa is thus sa — Ylm=i ^m(A)- 
For every r G {1, sa}, let be the insertion tableau as it appears immediately 
after insertion step r. 

Similarly, under shuffle B, the length of the insertion path of into Pb is 
lm{B)j and the total number of insertion steps involved in forming Pb is sb = 
Ylm=i ^m{B)i with denoting the insertion tableau after insertion step r. 

Example 2.10. As in Example 2.8, let v = • • • = uitst2U2t2Uiti, and let 
A = ti < ui < t2 < U2 < t^. Then tableau Pa is formed by the ^-RSK as follows 
(ignore the underlines). 
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Ui 



Ui 



t3 



Ui 









Ui 


t2 









Ui 


t2 








t3 



Ui 


t2 


t2 


Ui 


U2 













Ui 


t2 






U2 







For all i e {1, ...,7}, the underlined elements in tableau i lie in the insertion 
path of element Vi. Thus I^a) = kiA) = h{A) = 1, h{A) = h{A) = h{A) = 2, 
h{A) = 4, and sa = h(A) = 13. If for example, r = 7 = Xli=i k{A), then we 



have 





Ui 


t2 


t2 




Ui 


t2 


t2 


= 


U2 






pr+1 


Ui 








ts 








h 







Example 2.11. Let k = I = 1, A -.t < u, B : u < t, v = viV2 = tu. Then 
Pa : ^, , 



u 



Pb : 0, [T\ 



u 



; h{A) = 12{A) = 1, 



; h{B) = I5 12{B) = 2. 



Definition 2.12. For p,q E Z+, we say that ~ (with respect to the 
formations of Pa and Pb) if: 

1. Regions 1 and 3 are identical in P^ and Pg. 

2. Region 2 is identically shaped in P^ and P^; moreover, in each connected 
component of that region 2, the number of tj's (hence of ttj 's) in P^ equals 
the number of t^'s (hence of Wj's) in P^. 

3. Either p — sa and q — sb, or both p < sa and q < sb- In the latter case, 
the next insertion step involves inserting the same element into the same 
row (or column) in both tableaux. 

Example 2.13. The tableaux of Example 2.8 satisfy Pa ~ Pb- Regions 1 and 3 
in the two tableaux are identical, satisfying property 1 of Definition 2.12. Region 
2 consists of one component which is identically shaped, and contains exactly one 
ti and one Uj, in both tableaux. This verifies property 2. Since both tableaux 
correspond to p = sa and q = sb, property 3 is satisfied as well. ■ 
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Lemma 2.14. For any shuffle A & I, and for all p e (2, sa} and r, s e Z+, if 
c{r, s) contains some w in Pa~^, then c{r, s) contains some z <^ w in P^. 

Conversely, if c(r, s) contains some element z in P^, then c(r, s) was either 
empty or contained some w >^ z in P^~ . 

Proof. Follows from the ^-RSK algorithm. ■ 

The Proof of Theorem 2 clearly follows from 

Lemma 2.15. Let A, B E I be {ti^Uj) -adjacent, v e ak,i{n), v > {Pa,Qa) 

A-RSK 

and V > (Pr, Qr), then Pa ~ Pb- 

B-RSK 

Proof. We prove that Pa ~ -Pb, by induction on the insertion steps of Pa and 
Pb- Trivially P\ = P^. Now let p G {1, sa - 1}, g e {1,...,sb - 1} and 
assume that 1) Pj^ ~ P^, and also 2) either P^~^ ~ -^b"^ ^a~^ ^b~^ 
PT"^ ~ P^"\ We show that this implies that either PjJ+^ ~ P^+^ or Pj^+^ ~ P^+^ 
or P^^^ ~ -Ffi^^- This clearly implies the proof of the lemma (by induction on 
p + q). 

Note that if P^ ~ -Pr' ^^^^ 2.12.3, step p + 1 in P^ and step q' + 1 in Pr are 
identical; that is, the same element, x, is inserted into the same row (or column) 
in both tableaux. We assume that that x is a t-element, and therefore enters some 
row, denoted row r; the case where a; is a w-element is analogous. Since P^ ~ P^, 
row r is empty in P^ if and only if it is empty in Pg. The case where row r is 
empty is trivial, so we assume throughout that row r is nonempty in P^ and P^. 

1. Suppose that under both shuffles A and B, x > ti and Uj. Since P^ ~ -Pr' 
the last nonempty cell in row r must be in the same region in both P^ and 
P^, and if it is in region 3, then it must be occupied by the same element 
in both tableaux. 

Case 1.1: Row r in P^ (and in P^) terminates with an element less than 
or equal to x. In this CclSG, X IS affixed to the end of the row in both tableaux, 
so P^^ and P'^^ have the same shape and clearly satisfy properties 1 and 
2 of Definition 2.12. Let m denote the size of P^^^ and P'^^ ■ If m = n, 
which is the size of Pa and Pr, then the insertion algorithm terminates here. 
Otherwise, the next step is to begin fm+i's insertion path by inserting Vm+i 
into either the first row or the first column in both tableaux. This verifies 
2.12.3 and we have P2+^ - P|+\ 

Case 1.2: Row r in P^ contains an element z > x (under both A and 
B). Since Pj^ ~ P^, the same is true in P^. In this bumps an 

element greater than itself - a region-3 element ~ and occupies its cell in 
both tableaux. Thus both the cell occupied by x and the element bumped 
by X are identical in the two tableaux, which 2.12.3. Since 2.12.1 and 2.12.2 
clearly hold, it follows that P'^^ ~ P|+\ 



13 



2. Suppose that x = ti. During step Pr^^ ^ x — ti > ^ Uj bumps the first 

region-3 element in row r, or if no such element exists, x occupies the first 
empty cell in that row. Let c(r, s) be the cell occupied by x in P'^^ . 

Case 2.1: In row r of P^, region 2 either terminates with ti or does not 
appear at all in that row. Then x occupies c(r, s) also in (and bumps 

the same element as in Pg^^), so Pj^^ ~ Pb^^ ■ 

Case 2.2: In PjJ, the last region-2 element in row r is Uj. Let this Uj 
be in c(r, s'). Since P\ ~ Pg, c(r, s') is the last region-2 cell in row r in 
both tableaux. Since in Pg P'b^^ ^ ^ was inserted into c(r, s), we have 
s — s' + 1. Thus Uj is in c(r, s — 1) and is bumped hy x — ti to column s 
during P^ — > P^^ ■ We prove that in such a case, P^"*"^ ~ Pjt^- To do so, 
we show that 

2.2.1: In P^^ — > Pa^^i Uj settles in c(r, s), to the immediate right of x. 
2.2.2: This implies that 2.12.2 for PjJ+^ ~ P|+^ is satisfied. 
2.2.3: Both 2.12.1 and 2.12.3 for P^^^ - P|+^ are satisfied. 

Proof of 2.2.1: If r = 1, then tt^- clearly settles in c(r, s) in P^^^. We 
therefore assume that r > 1. 

To prove that Uj settles in c(r, s) in P^"*"^, we need only to show that 
c(r — 1, s) in PjJ^^ contains an element b < Uj, since c(r, s) in PjJ^^ contains 
some element z >^ Uj. Now, since r > 1, x = ti arrived at row r in P^ (and 
similarly in Pg) after being bumped from row r — 1 of P^"'. Let c(r-l,/i) 
be the cell occupied by x in P^"^, before it was bumped from row r — 1. 



pp-l , , pp+l , pP+2 

X is bumped X is inserted Itj is inserted 

from c(r — 1, /l) intoc(r, S — 1) into column S 

Since X is inserted into c(r, s — 1) of P^^^, Lemma 2.3 implies that s — 1 < 
/i. If s < h, then c(r — 1, s) was occupied by an element less than or equal 
to X in P^~^, and this continues to be true in P^ and P^^ , which implies 
our claim (that b < Uj). On the other hand, suppose that h = s — 1. In this 
case, we prove that c(r — 1, s) contains an element less than or equal to Uj 
by showing that otherwise we would have a contradiction to the induction 
assumptions. Our proof of this is illustrated by the following figures, each 
of which consists of the block of cells in rows r — 1 and r and columns s — 1 
and s in the corresponding tableaux. 

s s 





X 


b 


pp . 




b 


r ■ ■ ■ 






r ■■■ 


Uj 







b 


X 





pq- 





z 







pq- 



So, assume that in P\ , x occupied c(r — 1, s — 1), and c(r — 1, s) was 
either empty or contained an element b > uj (a region-3 element). We 
show that this contradicts the claim of the induction hypothesis, that either 

or 



pp 



pq- 

^B 



pp- 



pq- 

^B 



pp- 
^A 



pq- 

^B 



P|-2 ^ > P^B ' Pb'^' 

e is inserted X is bumped X is inserted 

intoc(r— l,s) from c(r — 1, s') into c(r, s) 

Now in -P^"*"^, X = ti occupies c(r, s), so c(r — is occupied by an 
element less than x. Lemma 2.3 implies that in P^, x occupied c(r — 1, s'), 
where s < s' ^ and this implies that in P^~^, c(r — l,s) contained an element 
e < X, a region- 1 or -2 element. But the same cell in P^~^ was either empty 
or contained a region-3 element, and by Lemma 2.14, the same must have 
been true in P^~^- Thus the above assumption, that h = s — 1, implies that 
neither P^~^ ~ Pb~^ Pa~^ ~ Pb~^ is satisfied. We show now that it 
also implies that oo . 

Suppose that ~ is satisfied. Denote by m the size of and 

Pb~^- By assumption, in P^~^ - hence also in P^~^ ~ Pa~^ ^ occupies 
c(r — — 1) and c(r — 1, s) is either empty or contains a region-3 element 
z > X. But we saw above that in P^~^, c(r — l,s) contained e < x. It 
follows that insertion step P^~^ — > Pb~^ consisted of e being inserted into 
c(r — 1, s), and - if c(r — 1, s) were previously occupied - of bumping from 
it some z > x. If e bumped some z, then in P^~^ Pg, z would have been 
inserted into either row r or column s + 1. But we saw earlier that x was 
bumped to row r in P^~^ — > P^, which implies that z must have bumped 
X during this step. This leads to a contradiction, since z could not have 
bumped x < z. Thus when e occupied c(r — l,s) during P^~^ — > P'b~^ i 
did not bump any element; the cell was previously empty. By occupying an 
empty cell, e increased the size of the tableau from m to m-|- 1: l-Pg"^! ~ ™' 
|P^~^| — m + 1. Hence |Pq| >m + l. 

On the other hand, is of size 777., and during Pj^ — > P^i was 

bumped from row r — 1 by some smaller element, so the size of the tableau 
did not change. It follows that = m < |-P^|, contradicting -P^ ~ -P^- 
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It follows that c(r — l,s) in contains an element b < uj, and this 

implies that when Uj enters column s in — > Pj^'^, it settles in c(r, s), 
to the right of x. This completes the proof of 2.2.1. 

Proof of 2.2.2: By 2.2.1, uj settles in c(r, s) in P^+^. We show that this 
implies that 2.12.2 for P^"*"^ ~ Pb^^ satisfied. In the diagrams below the 
proof, the cells outside of region 2 are marked with a 

Recall that by "Case 2.2" , Uj is located in c(r, s — 1) in P^, so c(r, s — 1) is 
part of a connected component of region 2. Let r = the number of tj's and 
fj, = the number of Uj^s in this connected component. By 2.12.2 of P^ ~ -Pb' 
region 2 of P^ contains a corresponding connected component (in the same 
cells as that of Pj^), with r t^'s and /U Wj's. 

Since is located in c(r, s — 1) in Pj^, by strict row inequality, c(r, s) is 
either empty or in region 3. Similarly, since x — ti occupies c(r, s — 1) in 
P^ — > Pj^ , c(r — 1, s — 1) must contain a region- 1 element in P^"*" (and in 







Uj 


-k 



Thus, if c(r — 1, s) is in region 2 in P^ and P^, then in both tableaux it is 
part of a connected component distinct from that of c(r, s — 1). This other 
component consists of r' t^'s and fx' it^'s. (If c(r — l,s) is not in region 2, 
then we let t' = fx' = 0.) 

Since c(r, s) is either empty or in region 3 in P^ (and thus in P^), it follows 
that the same is true for c(r, s + 1) and c(r + 1, s). By the assumption at 
the beginning of case 2, during P^ — > P^^^, x = U bumps some region- 
3 element z from c(r, s), thereby adding c(r, s) to region 2. But c(r, s) is 
adjacent to both c(r, s — 1) and c(r — l,s), so when it joins region 2, it 
combines their respective connected components into a single larger one. 
Since neither c(r, s + 1) nor c(r + 1, s) is in region 2, it follows that in Pg"*""*^, 
c(r, s) becomes part of a connected component of region 2, consisting of 
T + r' + l Ws Qxvd. ji + ji' Uj^s. 

s 



Similarly, during P^ — > P^"*"^ — > Pa^"^-, x = U bumps from c(r, s — 1), 
and bumps z from c(r, s) , so the only change in the shape of region 2 in 
P^"*"^ is the addition of c(r, s). Thus c(r, s) of P^^^ is part of a connected 
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component of region 2, also containing r + r' + 1 tj's and n -\- n' Uj^s, 
and this component is identically shaped to the corresponding component 
of P|+\ so 2.12 .2 of P^+^ ~ P|+^ is satisfied. This completes the proof 
of 2.2.2. 

Proof of 2.2.3: Property 2.12.1 is satisfied for P^+^ ~ P|+\ since in both 

— P^"*""^ and P^ Pa^^ ~^ -^A^^' region 1 is unchanged, and the only 
change in region 3 is the elimination of c(r, s). 

Since the same element z is bumped from c(r, s) in -P^^^ — > ^a^'^ 
— > P|^^, 2.12.3 is satisfied, and the proof of 2.2.3 is complete. 

It follows that P^+^ ~ P|+\ 

3. Suppose that x = ta < U. 

Case 3.1: Row r in P^ terminates with ^ < x. Thus z is in region 1, 
so by 2.12.1 of Pa ~ Pg; row r in P^ terminates with z. In such a case, 
X is afiixed to the end of row r in both tableaux, so P^^"^ and P^"*"^ have 
the same shape, and clearly satisfy 2.12.1 and 2.12.2. Let m denote the size 
of P^+^ and P'^+\ If m = n, which is the size of Pa and Pg, then the 
insertion algorithm terminates here. Otherwise, the next step is to begin 
Vm+i^s insertion path by inserting Vm+i into either the first row or the first 
column in both tableaux. This verifies 2.12.3 and we have P^^^ ~ Pb^^- 

Case 3.2: Row r in P^ (and hence in P^) contains an element greater 
than X. In both tableaux, x bumps from row r the leftmost element greater 
than itself. By 2.12.1 and 2.12.2 of P^ ~ P^, the same cell - denoted c(r, s) 
- becomes occupied by x in both tableaux. Thus if the element bumped by 
X is identical in the two tableaux, then P^^^ ~ ^b^^- 

Suppose, however, that x bumps different elements from the cell(s) c(r, s) 
of P^ and P^. By P^ ~ P^, these must be ti and Uj. Since x = ta occupies 
c(r, s) in P^~^^, Lemma 2.3 implies that in P^"^, x occupied c(r — 1, s') with 
s < s'. Thus the c(r — 1, s) element g in P^~^ was g < x < Uj,ti, so c(r — 1, s) 
was a region-1 cell. Since x was subsequently bumped from row r — 1 by an 
element smaller than itself, it follows that c(r — l,s) is a region-1 cell also 
in P^ (and Pg). Similarly, since x = ta < ti settles in c(r, s) in P^ P^ , 
c(r, s — 1) is a region-1 cell in P^^^ (and Pg"*"^), and in P^ (and Pg). 



(The stars represent region-1 elements.) 



17 



Now, since c(r, s) is in region 2 in both and P^, by 2.12.2, it is part of 
a connected component of region 2 which is identically shaped, and contains 
the same number of tj's and Wj's, in both tableaux. But c(r, s) contains ti in 
one tableau and Uj in the other, so it follows that at least one of c(r, s + 1) 
and c(r + 1, s) is in region 2 in P^ and P^. By strict row and column 
inequality, this implies that c(r, s) contains ti in P^ and in Pg. 

Denote by C the connected component of region 2 containing c(r, s). Con- 
sider the subcomponent Ci, consisting of all cells in C which are to the right 
of or above c(r, s). In P^, let a a = #ii's, and (3 a = i^Uj^s in Ci; define 
and /3b similarly in Pg. If c(r, s + 1) is not in region 2, then Ci is empty 
and a A — (3a — Q^b — — 0- On the other hand, if Ci is nonempty, then 
by strict row and column inequality, every northwest proper corner cell of 
Ci contains ti in P^ and Uj in Pg. 





u 






Uj 




pp . 




) ^B ■ 







Similarly, every southeast proper corner cell of Ci contains uj in P^ and ti 



in Pi. 



pp . 

^A • 




pi . 
7 ^B • 








Uj 






ti 



Consider the top row of Ci. If it contains more than one cell, then its 
leftmost cell is a northwest corner. Thus the structure of Ci is as in the 
following diagram, where for example, a cell marked ti/uj contains ti in P^ 
and Uj in P^. (A mark of ? denotes that a cell may contain either ti or Uj.) 
and elements 

ti j Uj ?/ ti 

Ujjti 

?? 

On the other hand, if the top row of C\ contains only one cell, then the 
structure of C\ is 



ti/Uj ■ ■ 
Uj/ti 

In both cases it follows that aB — ola 
3.2.1: aB - oiA = 13a- 13b = = 
3.2.2: aB-aA = Pa- Pb = ^ = 

Let C2 be the subcomponent of C consisting of all cells below or to the 
left of c(r, s). Let = ij^ti^ and 5a = ifuj^s in C2 of P^, and define 7b 
and 5b similarly for P^. Since neither c(r — 1, s) nor c(r, s — 1) is in region 
2, it follows that C = Ci + C2 + c(r, s). By 2.12.2 of - P|, C contains 
the same number of tj's and Mj-'s in as in P^. In both tableaux, let r be 
the number of tj's, and fi be the number of tt^'s, in C. Since c(r, s) contains 

in P^ and ttj in P^, it follows that: 

T = aA + jA + l ^ (Xb +JB, n ^ (3a + 5a ^ Pb + 5b + 1- 

Proof of 3.2.1: Suppose that ckb — = — /3b = 1. Then ^a — 1b — 
5b — 5a = ^1 C2 is either empty or contains an equal number of tiS and 
ttj's in P^ as in P^. Also, Ci is nonempty, so c(r, s + 1) is in region 2 in P^ 
and in P^. In P^, c(r, s) contains m-,-, so by strict row inequality c(r, s + 1) 
contains t^. The subsequent insertion steps are therefore 

Pa — ^ Pa"^ 

bumps ti ti enters 

from c(r, s) row r + 1 



Uj/ti 



= Pa- Pb & {0, 1}. We prove that 



P| p|+i p|+2 



X bumps Uj Uj bumps ti enters 

from c(r, S) from c(r, S + 1) row r + 1 



Thus in both Pj^ — PjJ^^ and P^ — Pg^''^ Pb^"^ ^ c(r, s) is eliminated 
from region 2, and we are left with two separate components Ci and C2 (and 
with ti to be inserted into row r + 1). No change occurs in C2, so in both 
Pa^^ and Pg^^, C2 has 7^ = 75 t^'s and 5^ = 5b tt^'s. Similarly, no change 
occurs in Ci in P^ — > P^^^, so Ci of P^"*"^ contains a a tiS and w^'s. On 
the other hand, in P^ — > Pg"*""^ — > Pb^^, a single change occurs in Ci, when 
the in c(r, s + 1) is replaced with Uj. Thus Ci of P^^^ contains aB-^ ^i's 
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and /3b + 1 Wj's. But by 3.2.1, — 1 = and /3b + 1 = Pa, so Ci contains 
the same number of t^'s and tt^ 's in -P^"''^ as in P^^^, and 2.12.2 is satisfied 
for PP+^ ~ P|+^ 

Now in both P^^^ and -P^^^, the only change that occurs in region 1 is 
that the same element x is added to c(r, s), so 2.12.1 is satisfied. Similarly, 
as was already mentioned, both -P^^^ ^a^"^ -^s^^ ~^ ^b^^ consist of 
ti entering row r + 1, so 2.12.3 is satisfied. It follows that P^^^ ~ Pr^^- 
This completes the proof of 3.2.1. 

Proof of 3.2.2: The proof of 3.2.2 is dual, in a sense, to the proof of 3.2.1. 
Here are the details. 

Suppose that — a a — /3 a ^ 0b = 0. Then Ci is either empty or 
contains an equal number of t^'s and uj^s in Pj[ as in P^. Thus by (★), 
^B — — ^A — Sb — 1, SO C2 is nonempty, which implies that c(r + 1, s) 
is in region 2 in P^ and in P^. In P^, c(r, s) contains ti, so by strict 
column inequality c(r + 1, s) contains Uj. The subsequent insertion steps are 
therefore 



X bumps ti ti bumps Uj enters 

from c(r, s) from c(r + 1, s) column S + 1 



bST 77 



X bumps Uj Uj enters 

from c(r, s) column S + 1 

Thus in both P^ P^+^ ^ P^^^ and P^ ^ P^+\ c(r, s) is eliminated 
from region 2, and we are left with two separate components Ci and C2 (and 
with to be inserted into column s + 1). No change occurs in Ci, so in 
both Pa^'^ and P^^^ , Ci has = t^'s and = Uj^s. Similarly, 
no change occurs in C2 in P^ — » P^^^, so C2 of P^^^ contains 7^ tj's and 
Sb Wj-'s. On the other hand, in P^ ^a^^ ~^ -^a^^' ^ single change occurs 
in C2, when the Uj in c(r + l, s) is replaced with ti. Thus C2 of P^^^ contains 
7yi + 1 ti's and 5^ — 1 'itj's. But 3.2.2 and {-k) imply that 7a + 1 = 7b and 
Sa — i = Sb, so C2 contains the same number of tj's and tt^ 's in P*^"*"^ as in 
P|+\ and 2.12.2 is satisfied for P^+^ ~ P|+^ 



Now in both P*^"*"^ and Pr^^, the only change that occurs in region 1 



IS 



that the same element x is added to c(r, s), so 2.12.1 is satisfied. Similarly, 
as was already mentioned, both Pj^^^ ^a^^ ^b^^ ~^ ^b^'^ consist of 
Uj entering column s + 1, so 2.12.3 is satisfied. It follows that P^^^ ~ Pb^^- 
This completes the proof of 3.2.2. ■ 



3 The Proof of Theorem 5 
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Here we prove, for example, Theorem 5(b). The proofs of parts (c) and (d) of 
that theorem are similar. 

Given v G ak,i{n) and shuffle A, the (regular, dual)-A-RSK forms the tableau 
pair (P*, Q*) = {P*{v, A), Q*{v, A)) by applying the regular RSK to the t^'s, and 
the dual conjugate RSK to the Uj 's of v under shuffle A. For simplicity, we refer to 
this algorithm as the dual-^-RSK. As in the ^-RSK, P* is the insertion tableau, 
and Q* is the recording tableau of v under A. Here P* is what we call a dual- 
^-SSYT; that is, it is weakly ^-increasing in rows, and strictly ^-increasing in 
columns. 

Example 3.1. Let k = 2, 1 = 1, and A : ui < U2 < ti < t2- Let 

1 4 



Then, 



dual-A-RSK 



and 



Ui 




Ui 


tl 




Ui 


tl 


t2 



Q* = 



1 


2 


3 


4 





Ui 


Ui 


t2 


tl 





p* 



Lemma 3.2. Let v e ak,i{n), A e I and 

{P,Q), 



{P*,Q1- 



A-RSK dual-A-RSK 

If V is non-repeating in its u-elements, then P = P* and Q = Q" 



Proof. The A-RSK and the dual-A-RSK differ in only one rule: When some 
Uj enters a column under the A-RSK, it bumps the first element Wm such that 
Wm > Uj (or if no such Wm exists, it settles at the end of the column). On the other 
hand, under the dual-A-RSK, Uj bumps the first element Wr such that Wr > Uj 
(or settles at the end of the column). But Uj may appear only once in w, which 
implies that Wr > Uj, so this step is the same as that of the A-RSK. The proof 
now follows. ■ 



Notation, v G ak,i{n) is said to be of type (cti, ...,ak;Pi, A) if it is a permu- 
tation of •••^r^f •••'"f'- 
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Lemma 3.3. Let v e (ik,ii'>^) be of type (cii, a^; and denote (3 = 
Yl\=i Pi- Then there exists w E ak,j3{n) such that 

1. The u-elements of w are non-repeating. 

2. For every shuffle A, ifv > {Pyi Qt), then there exists a correspond- 

dual-A-RSK 

ing shuffle A' of the elements of w such that w > (P*,Q*), where 

dual-A-RSK 

P* is identical to P* but with every Vi changed to wi for all i < n. Conse- 
quently, sh.{P*) = sh(P*). 



Proof. To avoid confusion between the elements of v and of w, we let Ui,...,u'i 
denote the w-elements of v. 

Form the sequence w from v as follows. Replace the u'lS in v with ui, Uyj^, 
moving from right to left. Replace the U2^s with w^i+i, tt^i+/32, moving from 
right to left. Continue in this way until ttj, and including the •uj's. 

Clearly the w-elements of w are non-repeating, satisfying 3.3.1. 

Given some shuffle A of the elements of v, define the shuffle A' of the elements 
of w as follows. For every i e {1, A;}, 



ti <^ u[ =^ ti ui ■■■ u^^ 

ti <A U2 =^ ti W^^+i • • • ■"/31+/32 

ti <^ Ui =^ ti + + i • • • 



u\ <^ti 



Ul • • • V <A' ti 



u'l <^ ti 



'"/3i+ - +/3;_i + l <A' 



^ Ai ^ A' ti 



We compare the A-RSK insertion of the f 's with the A'-RSK insertion of the 
ty's. Note that the shuffle A and its derived shuffle A' are similar in that Vi <^ 
Vj =^ Wi Wj, but they differ in one fundamental way: For i < j such that 
Vi,Vj,Wi and Wj are w-elements, Vi =^ Vj Wi Wj. Now, if Wj reaches 

a cell inhabited by wi > ^, Wj, then it bumps Wj to the next column, just as Vj 
would bump Vi Vj to the next column under the dual-A-RSK. On the other 
hand, if Wi reaches a cell inhabited by Wj Wi, it settles below Wj, whereas Vi 
would bump Vj =^ Vi to the next column. However, such a situation never occurs, 
since i < j and Vi =^ Vj implies that every column reached by Wj is first reached 
by Wi. The proof of this is as follows. 

Suppose that for some x, Wi — Ux+i and Wj = Ux- Then every column reached 
by Wj is first reached by Wj, by induction on the columns of P^. Trivially, Wi 
reaches column 1 before Wj. By the induction assumption, Wi = Ux+i is in column 
c', c' > c. If c' > c, then we are done. Assume c' = c' : Wi = Ux+i is already in 
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column c, and wj — Ux is inserted into column c. It bumps the first such that 
Wd > Wj = Ux- Now Vi =^ Vj implies that there does not exist any tg such that 
Wj tz Wi. Hence Wd — Ux+i = wi is bumped to column c+ 1. 

This clearly extends to the general case i < j, Vi = vj, Wi = Uy, wj = Ux, for 
general y > x. 

Hence the steps of the dual-^'-RSK on w are identical to the steps of the dual- 
^-RSK on V, but with every Vi, i < n, changed to Wi. This implies that 3.3.2 is 
satisfied for tu. ■ 



Example 3.4. Let v = t2U2UiUiti, and A = ti < t2 < Ui < U2- The sequence 
w = t2u'^U2u[ti clearly satisfies 3.3.1; we show that it satisfies 3.3.2 for shuffle A, 
by letting A' — ti < t2 < u'l < U2 < u'^. Under shuffles A and A', 

dual-A'-RSK {PwiQw)i 

where 



tl 


Ui 


Ui 


U2 




V5 


V4 


V3 


V2 


t2 










Vl 





tl 


u'l 


u'2 






W5 


W4 




W2 


t2 










Wi 





Thus 3.3.2 is satisfied for shuffle A. ■ 



We can now give 

The Proof of Theorem 5(b). Let v be of type (cti, ak] Pi, Pi), and denote 
P — Yl\^i Pi- Lemma 3.3 implies that there exists a sequence w e ak,f}{n) with no 
repeating tt-elements, and with shuffles A' B' such that 

dual-A'-RSK ^ ^ ' ^' dual-B'-RSK ^ ' ^' 

where sh(P^,) sh(P^) and sh(P^,) = sh(P^). Since w contains no repetitions 
in its M-elements, Lemma 3.3 implies that 

Thus by Theorem 2, sh(P^,) = sh(P^,), which implies our result. ■ 

The proofs of parts (c) and (d) of Theorem 5 are similar to that of Theorem 5(b) , 
since Lemma 3.3 can be applied also to the (dual, regular)-A-RSK and the (dual, 
dual)-^-RSK. Both algorithms are t-dual; for simplicity, let t[,...,t'f^ denote the 
t-elements of v. The Vs of the sequence w of Lemma 3.3 for parts (c) and (d) 
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are set as follows. Replace the t'^s in v with ti, ...,ta^, moving from left to right. 
Replace the t2^s with ta^+i, ...,ta-^+a2J moving from left to right. Continue in this 
way until t^, and including t^. 

Since the (dual, regular)-A-RSK of part (c) is ^-regular, the w's of w are identical 
to those of V. However, the (dual, dual)-A-RSK of part (d) is u-dual, so in this 
case the m's of are derived the same way as in the proof of Lemma 3.3. Finally, 
shuffle A' is derived from A in parts (c) and (d) by methods analogous to that of 
part (b). 
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